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DIRECT  TRANSFORMATION  OF  VARIATIONAL  PROBLEMS 
INTO  CAUCHY  SYSTEMS.  I.  SCALAR-QUADRATIC  CASE* 

by 
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James  Hess  and  Robert  Kalaba 

ABSTRACT:  This  series  of  papers  addresses  three  interrelated  problems; 
the  solution  of  a variational  minimization  problem,  the  solution  of 
integral  equations,  and  the  solution  of  an  initial  valued  system  of 
integrodifferential  equations.  It  will  be  shown  that  a large  class 
of  minimization  problems  requires  the  solution  of  linear  Fredholm 
integral  equations.  It  has  also  been  shown  that  the  solution  of  a 
linear  Fredholm  integral  equation  is  identical  to  the  solution  of  a 
Cauchy  system.  In  this  paper,  we  by-pass  the  Fredholm  integral  equations 
and  show  that  the  minimization  problem  directly  implies  a solution  of 
a Cauchy  system.  This  first  paper  in  the  series  looks  only  at  quadratic 
functionals  and  scalar  functions. 
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1.  INTRODUCTION 

Many  interesting  optimization  problems  result  in  variational  problems 
of  finding  a function  z(t),  0 £ t < 1,  that  minimizes  the  functional 

W[2]  = wj  /J  2(s)k(t.s)z(t)dtds  + /J  z(t)^dt  + 2 f(t)z(t)dt. 

By  standard  variational  techniques  it  can  be  shown  that  the  optimal  func- 
tion, u(t),  satisfies  a linear  Fredholm  integral  equation  (Ref.  1).  Recent 
work  in  the  study  of  integral  equations  (Ref.  2)  has  shown  that  solutions 
of  integral  equations  are  equivalent  to  solutions  of  particular  initial 
valued  systems  of  integrodifferential  equations  (Cauchy  systems).  It 
appears  that  the  three  problems  --  variational,  integral  equations,  and 
Cauchy  systems  — are  equivalent  to  each  other.  An  important  missing  link 
in  the  analysis  has  been  the  demonstration  that  the  variational  problem 
leads  directly  to  a Cauchy  system  without  passing  through  an  integral  equa- 
tion. These  papers  provide  that  link.  It  would  seem  that  the  historical 
emphasis  put  on  the  integral  equations  is  but  an  accident.  The  Cauchy 
systems  can  just  as  easily  be  developed  and  provide  interesting  insights 
and  computational  aid  in  studying  such  variational  problems. 

The  direct  reduction  of  the  simplest  problem  in  the  calculus  of 
variations  to  a Cauchy  system  is  given  in  Ref.  3;  the  train  of  thought 
is  quite  different  from  that  employed  here. 

2.  DERIVATION 

Suppose  we  desire  to  find  a Scalar  function  z(t),  0 t ^ 1,  which 


minimizes  the  quadratic  functional 
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W[z,a]  = x/q  /q  z(s)k(t,s)z(t)dsdt  + z(t)^dt  + 2 /J  f(t)z(t)dt,  (1) 

where  k(t,s)  is  a symmetric,  positive  definite  kernel,  f(t)  is  a given 
function,  and  X is  a sufficiently  small  nonnegative  scalar  parameter.  The 
standard  variational  approach  to  this  problem  results  in  a linear  Fredholm 
integral  equation  which  the  optimal  function  must  satisfy. 

PROPOSITION  1:  The  function  u(t)  which  minimizes  W[u,x]  must  satisfy 
the  linear  Fredholm  integral  equation 

u(t)  + f(t)  + ^ Tq  k(t,s)u(s)ds  = 0,  0 £ t £ 1.  (2) 

PROOF:  Denote  the  optimal  function  u(t).  The  arbitrary  admissable 
functions  may  be  written  as 

w(t)  = u{t)  + en(t) , 

where  e is  an  arbitrary  scalar,  and  Ti(t)  is  an  arbitrary  function. 

The  value  of  the  functional  for  w(t)  may  be  expressed  as 

W[w;x]  * W[u,x]  + eC[u,n;x]  + e^D[n»A], 

where 

C[u,n;x]  = 2 X /J  /J  u(s)k(t,s)n(t)dsdt  + 2 /J  u(t)n(t)dt  + 2 f(t)n(t)dt 

D[n.x]  = X /J  n(s)k(t,s)n(t)dsdt  + /J  n(t)^dt. 

2 

For  t sufficiently  small  the  term  in  e may  be  ignored.  If  u is  in 
fact  the  minimizing  solution, then  for  all  e 


0 
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C[u,n;x]  = 0.  (3) 

Applying  the  fundamental  lemma  of  the  calculus  of  variations 
(/q  g(t)h(t)dt  = 0 for  arbitrary  h(t)  implies  g(t)  = 0 for  all 
0 £ t £ 1 (Ref.  1))  to  Eq.  (3),  since  n(t)  is  arbitrary,  we  get 
Eq.  (2).  O.E.D. 

Another  approach  to  the  minimization  problem  is  to  ask  how  the  optimal 
solution  changes  as  x varies.  This  is  referred  to  as  parametric  imbedding. 
The  standard  technique  would  begin  with  the  linear  Fredholm  integral  equa- 
tion and  convert  it  into  a system  of  initial  valued  integro-differential 
equations.  The  basic  result  given  in  Ref.  2 is 

PROPOSITION  2:  The  function  u(t,x)  which  satisfies  the  linear  Fredholm 
integral  Equation  (2)  is  the  solution  u(t,x)  to  the  following  initial 
valued  integro-differential  equations  in  u,  augmented  by  a resolvent 
kernel  K(t,s,x),  and  conversely: 


0 * Uj^(t,X)  +f(t.X)  + /J  K(t,s,x)ij;(s,x)ds 

(4) 

Kj^(t,s,x)  = /g  K(t,s'.x)K(s',s.x)ds' 

(5) 

u(t.O)  * -f(t) 

(6) 

K(t,s,0)  - -k(t,s) 

(7) 

♦(t.s)  » /J  k(t,s)u(s,x)dx 

(8) 

O^s^l. 

(9) 
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The  Cauchy  system  (4)-(9)  has  proved  to  be  very  useful  for  the 
computation  of  the  solution  of  Fredholm  integral  equations,  as  well  as 
for  the  study  of  the  sensitivity  of  the  solution  to  changes  in  the  para- 
meter X. 

We  will  now  show  that  the  Cauchy  system  (4)-(9)  may  be  derived 
directly  from  the  original  minimization  problem,  without  ever  writing 
down  the  Fredholm  integral  Equation  (2).  In  fact,  the  solution  of  the 
minimization  problem  could  have  preceded  even  if  historically  the 
Fredholm  integral  equation  had  never  been  discovered.  The  Cauchy  system 
is  perfectly  adequate  for  describing  the  optimal  function  u(t). 

PROPOSITION  3:  The  function  u(t,x)  which  minimizes  W[u;x]  satisfies 
the  Cauchy  system  (4)-(9). 

PROOF:  Suppose  u(t,x)  is  the  minimizing  function  for  parameter 
value  X,  and  suppose  u(t,x+dx)  is  the  minimizing  function  for 
parameter  value  x+dx;  then  the  first  variations  must  satisfy  the 
following  inequalities  for  arbitrary  e,  n.  e,  n: 

EC[u(t,x),n;x]  i 0 (10) 

EC[u{t,x+dx),  n;  X+dx]  ^ 0.  (11) 

Since  e,  n,  c,  n are  all  arbitrary,  pick  n * n and  e * -e  so  that 
(10)  and  (11)  are 

-EC[u(t,x) ,n;x]  ^ 0 


EC[u(t.x+dx),  n;  x+dx)  > 0. 
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Add  these  two  Inequalities  to  get 

£[2  X /Q/Q(u(s,A+dA)-u(s,x) )k(t,s)n(t)dsdt+2  /J(u(t,A+dA)-u(t,A))n{t)dt 

+ 2 dx  /q/q  u(s.x+dx)k(t.s)n{t)dsdt]  ^0.  (12) 

Since  I has  arbitrary  sign,  the  term  in  square  brackets  in  (12)  must 
be  zero.  Since  n(t)  is  arbitrary,  apply  the  fundamental  lemma  of  the 

t 

calculus  of  variations  to  the  bracketed  term  to  get 
2 X k(t,s)(ti(s,x+dx)-u(s,x))ds+2(u(t,x+dA)-u(t,x)) 

+2d A /q  u(s,A+dA)k(t,s)ds  = 0.  (13) 

Divide  (13)  by  Zdx  and  take  the  limit  as  dx  ■*  0, 

0 = Uj^(t,A)  + A /g  k(t,s)u^(s,A)ds  + k(t,s)u(s,A)ds.  (14) 

This  is  a Fredholm  integral  equation  with  kernel  k(t,s).  Corresponding 
to  k(t,s)  is  a resolvent  kernel  K(t,s,A)  such  that  solutions  of 
Fredholm  integral  equations 

0 = v(t)  + i|)(t,A)  + A k(t,s)v(s)ds  (15) 

can  be  expressed  as 

0 « v(t)  + i|/(t,A)  + X /q  K(t,S,A)iJ((x,A)dS. 

Using  the  resolvent  kernel  to  express  the  solution  of  (14),  where 
♦(t.x)  * k(t,s)u(s,A)ds,  we  get 

0 • u^(t,A)  + i(i(t,X)  + A /"g  K(t,5,A)«/(s,A)ds. 
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This  is  nothing  other  than  Eq.  (<!)  of  the  Cauchy  system.  The  resol- 
vent kernel  must  itself  satisfy  a Fredholm  integral  equation 

0 = K(t,s,x)  + k(t,s)  + X /q  k(t,s')K(s' ,s,x)ds' . (16) 

Differentiate  (16)  with  respect  to  x to  get 

0 = K^(t,s,x)  + /J  k(t,s')K(s' ,s,x)ds'  + x k(t,s’)Kj^(s',s,x)ds. 

(17) 

From  Eq.  (16)  we  can  reexpress  the  second  term  of  (17): 

0 = K^(t,s,x)  - j (K(t,s,x)  + k(t,s))  + X /J  k(t,s')K^(s',s,x)ds'. 

(18) 

However,  Eq.  (18)  is  a Fredholm  integral  equation  with  the  same  ker- 
nel as  Eq.  (15).  Its  solution  may  be  expressed  using  the  same  resol- 
vent kernel  K(t,s,x), 

0 = Kj^(t,s,x)  - \ (K(t.s,x)  - k(t,s))  + X K(t.s,x) 

-(i)(K(s',s,x)  + k(s*,s))ds'.  (19) 

Using  Eq.  (16)  again,  several  terms  in  Eq.  (19)  cancel  out,  leaving 
K^(t,s,x)  = /J  K(t,s',x)K(s',s,x)ds' 

which  is  just  Eq.  (5)  of  the  Cauchy  system.  To  get  the  Initial  con- 
ditions (7),  set  X » 0 in  Eq.  (16).  To  get  initial  condition  (6) 

set  X ■ 0 in  W[z,x].  The  minimizing  function  u(t,0)  of 
/J  u(t,0)^dt  + 2 f(t)u(t.0)dt 

can  easily  be  shown  to  be  u(t,0)  * f(t).  Q.E.D. 

t 
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3.  DISCUSSION 

The  main  purpose  of  this  paper  has  been  to  reduce  the  quadratic 
variational  problem  in  Eq.  (1)  to  the  Cauchy  system  in  relations  (4)-{9). 
In  particular  we  have  been  able  to  do  this  without  making  any  use  of  the 
Euler  equation,  which  takes  the  form  of  the  Fredholm  integral  equation 
(2). 

Subsequent  papers  in  this  series  will  be  devoted  to  systems  and  to 
the  treatment  of  non-quadratic  variational  problems.  Application  to  team 
decision  theory  and  other  areas  will  be  presented. 
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